Evaluating and Comparing Ontology Alignment Systems: An Mcdm Approach
نویسندگان
چکیده
Ontology alignment is vital in Semantic Web technologies with numerous applications diverse disciplines. Due to diversity and abundance of ontology systems, a proper evaluation can portray the evolution depicts efficiency system for particular domain. Evaluation help designers recognize strength shortcomings their aid application developers select system. This article presents new comparison methodology based on multiple performance met-rics that accommodates experts' preferences via multi-criteria decision-making (MCDM) method, i.e., Bayesian best-worst method (BWM). First, importance metric specific task/application determined according preferences. The systems are then evaluated proposed expert-based collective (ECP) takes into account metrics as well calibrated importance. For , ranked probabilistic scheme, where it includes extent which one preferred over another. applied six tracks from initiative (OAEI), by designing survey eliciting experts. Accordingly, participating OAEI 2018 ranked. While demonstrate its applicability, also be any benchmark or alignment.
منابع مشابه
Evaluating ontology alignment methods
Many di erent methods have been designed for aligning ontologies. These methods use such di erent techniques that they can hardly be compared theoretically. Hence, it is necessary to compare them on common tests. We present two initiatives that led to the de nition and the performance of the evaluation of ontology alignments during 2004. We draw lessons from these two experiments and discuss fu...
متن کاملEvaluating Ontology Alignment Systems in Query Answering Tasks
Ontology matching receives increasing attention and gained importance in more recent applications such as ontology-based data access (OBDA). However, query answering over aligned ontologies has not been addressed by any evaluation initiative so far. A novel Ontology Alignment Evaluation Initiative (OAEI) track, Ontology Alignment for Query Answering (OA4QA), introduced in the 2014 evaluation ca...
متن کاملEvaluating a Confidence Value for Ontology Alignment
Many methods for automatic and semi-automatic ontology alignment have been proposed, but they remain error prone and laborintensive. This paper describes a novel generic process for evaluating the mappings’ confidence value. This process uses rules extracted through inductive machine learning methods from the matching results proposed by others. Further, the precision and recall of the extracte...
متن کاملA Tool for Evaluating Ontology Alignment Strategies
Ontologies are an important technology for the Semantic Web. In different areas ontologies have already been developed and many of these ontologies contain overlapping information. Often we would therefore want to be able to use multiple ontologies. To obtain good results, we need to find the relationships between terms in the different ontologies, i.e. we need to align them. Currently, there e...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Social Science Research Network
سال: 2021
ISSN: ['1556-5068']
DOI: https://doi.org/10.2139/ssrn.3769873